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WASHINGTON STATEWIDE EDUCATIONAL ASSESSMENT 



STATE GENERAL REPORT 



ELEVENTH GRADE 



INTRODUCTION 

In 1976 the Washington State Legislature enacted legislation (RCW 
28A.03.360) which created the Washington Statewide Educational Assessment 
Program. The State Assessment Program requires that a sample of public 
school Uth grade students be tested at least once every four years in the 
basic skills of reading, language arts, and mathematics. Pursuant to the 
legislation a sample of 11th grade students was tested in the Spring of 
1977 using test items available from the National Assessment of Educational 
Progress. The results of the 1977 Uth grade assessment were published in 
August, 1977. 

m 

In. the spring of 1981 a carefully selected sample of Uth grade students 
was tested with the California Achievement Test (CAT). The sample was 
selected to allow the results to be generalized to the more than 59,000 
Uth grade students in Washington's public schools. The Legislature's 
stated purpose for these surveys is to allow che public and the Legislature 
to judge how Washington Uth graders' achievement in reading, language, and 
mathematics compares with Uth grade achievement nationally. The remainder 
of this report describes the procedures and results of the second statewide 
assessment of Uth grade achievement. 
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OVERVIEW OF ASSESSMENT PROCEDURES 

It was determined that the range of items available from the National 
Assessment item pool was too restricted to provide adequate coverage of 
Washington's basic skills programs. Therefore^ the decision was made to 
seek a more comprehensive test of achievement in the basic skills. The 
Superintendent issued a ''Request for Proposals" to the publishers of survey 
tests of basic skills widely used in the State of Washington. The 
Superintendent's "RFP" detailed the kinds of services, score reports and 
interpretation materials required for the testing program. Responses to 
the Superintendent's RFP were received from five publishers. Based on the 
unanimous recommendations of an independent review panels the California 
Achievement Test (CAT) Form C, was selected for use at grades 4^ and 11 
as prescribed by RCW 28A.03.360 

For the Springy 1981 11th grade testingi a two-stage cluster sample design^ 
for the total grade 11 population was developed and implemented. In the 
first stage 64 schools enrolling 11th grade students were selected. The 
5;econd stage involved requesting 11th grade rosters from each school 
selected in the first stage. From these rosters , a sub-sample of students 
was selected from each school. This sample design resulted in a proba- 
bility sample of students with each student in the total population having 
an equal probability of selection thus resulting in a self-weighting 
s arop 1 e • 



GENERAL STATE LEVEL RESULTS 

The CAT provides scores in seven basic skill areas: reading vocabulary, 
reading comprehension, spelling, language mechanics, language expression. 
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mathe««tic« computation and mathematics concepts and applications. The CAT 
results for the sample of Washington Uth graders are reported in twb ways: 
the mean national percentile ranks and the percentages of students scoring 
in the four norm group quarters on each of the seven sub- tests, the three 
sub-test totals and the combined battery total. 

A percentile rank describes the relative position of a student within a 
specified group of students. The specified group of students is called the 
norm group. When the norm group is based on a national sample of students, 
the score is called a national percentile rank. A percentile rank score 
indicates the percentage of students in the norm group whose scores were 
equal to or lower than the score reported. The mean percentile rank 
indicates the average score of a group of scores converted to the corre- 
sponding percentile rank in the national norm group. The average score in 
the national norm group always corresponds to the 50th percentile. To the 
extent a specific group's mean percentile rank exceeds the 50th percentile, 
it can be concluded that the general level of the group's performance 
exceeds that of the national norm group. 

The mean percentile ranks for Washington were calculated by converting the 
raw scores (number correct on the test) of each student to a scale-score. 
(Scale-scores are special scores that have mathematical characteristics 
that allow them to be averaged without distorting the scores' meaning.) The 
Washington students' scale scores were then averaged on each sub-test and 
the resulting mean scale-score for the sub-test was converted to its 
equivalent national percentile rank for comparison purposes. 
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Because the results reported are based on a sample and not the entire 
population of 11th grade students, the scores are estimates of the popula- 
tion scores. That is, the scores are the estimates of what the scores 
would have been if all 11th grade students had been tested. Because the 
sample was carefully designed and selected, the error associated with these 
estimates is very small and can be calculated. In fact, one of the ad- 
vantages of a carefully designed sample is that error variance can be 
calculated. This is not the case when an entire population is surveyed, 
though error is present even in surveys of entire populations. Appendix A 
gives the standard errors associated with each of the mean scores on each 
sub-test of the CAT. The error range in percentile units can also be 
calculated using the publisher's empirical norms tables* 

In addition to the mean percentile scores, the percentages of students 
scoring in each of the national norm group quarters provide another basis 
for analyzing Washington* s performance on the CAT. The national norm 
group's scores were divided by the publisher into four equal groups or 
quarters: first quarter (percentile ranks 1-25), second quarter (per- 
centile ranks 26-50), third quarter (percentile ranks 51-73), and fourth 
quarter (percentile ranks 76-99). It follows that 25X of the students in 
the national norm group had scores in each quarter. If Washington's dis- 
tribution of scores was like that of the national norm group, 25t of 
Washington's scores would be in each quarter. To the exent the percentages 
of Washington's scores in each quarter vary, Washington's performance 
differed (higher or lower) from the national norm group. The two middle 
quarters (percentiles 26-75) are generally considered an "average" range of 
achievement . 



Table 1 provides the percentages of Washington 11th grade students scoring 
in each of the norm group quarters for each of the sub-tests on the CAT. 
At the bottom of each sub-test column the mean national percentile rank is 
included for each sub-test. 

TABLE 1.* PEKCEKIAGES OF WASHIMCTOII ELEVEJITH GRADE STUDElfrs SCORING IN 
EACH QUARTER AND MEAN NATIONAL PERCEimLE RANK ON THE CAT 

HOtM 

GROUP READ READ READ LANC LANG LANG HATH MATH MATH TOTAL 

QUARTERS VOCAI COKP TOTAL S?ELL HECH EZFR TOTAL COHP CO/AP TOTAL BATT 



27Z 29Z 



38Z 36X 



25Z 26Z 



lOZ 9Z 



Mean 

N«t*l 50 62 63 62 57 58 61 57 61 61 62 61 

Ziie 

RAok 



^Percentages and percentile ranks have been rounded to the nearest whole 
number. 

The results in Table 1 indicate that compared with the national norm group, 
Washington's scores were consistently high across all sub-tests. Even 
Washington's lowest mean percentile ranks (57 in the spelling and language 
total sub-tests) are significantly above the mean percentile rank of 50 for 
the national norm group. In no case does the percentage of Washington 
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students in the lowest quarter exceed 19%, and in all cases the percentages 
of Washington students in the upper quarters equals or exceeds 23Z. On the 
total battery score 29% of Washington's students scored in the upper 
quarter and only 9Z scored in the lover quarter compared with the national 
norm group's results of 25% each in the upper and lower quarters. 

SPECIFIC SUB-TEST RESULTS 

The California Achievement Test surveys students in seven basic skill 
areas. These areas are tested by separate sub-tests within the total 
battery. This section of the report focuses on the performance of 
Washington's 11th graders on each of the CAT sub- tests* 

Reading Vocabulary 

Vocabulary knowledge is important for understanding concepts and verbal and 
written communication. Level 19 of the CAT focuses on three general areas 
of vocabulary skills: words with the same meaning, words with opposite 
meanings and multimeaning words. Words of the same or oppooite meanings 
are tested by placing the "stimulus" word in a phrase and asking the 
student to select the word with the same (or opposite) meaning from a group 
of four words. Words with mul timeanings are tested in sentences where 
context is important to determine the intended word meaning. There are 30 
items on the reading vocabulary sub- test and Washington students answered 
an average of 70% correct compared to an average of 62% correct for the 
national norm group. 
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Reading Co«prehen»ion 

Reading comprehension includes word recognition and word aeaning skills; 
but these decoding and vocabulary skills are only a neans to lomprehension. 
Successful reading comprehension requires the student to atf:ach meaning to 
the broader sentences and concepts which make up a reading passage. Read- 
ing comprehension on the CAT is divided into literal, interpretive, and 
critical comprehension. Literal comprehension concerns what is actually 
stated in a passage — the recognition and recall of facts. Interpretive 
comprehension requires students to determine (infer) what is implied in a 
passage. Such skills as identifying main ideas, drawing conclusions, 
recognizing cause and effect relationships, analyzing characters and inter- 
preting figurative language are included in interpretive comprehension. 
Critical comprehension tests student's skills in evaluating and making 
judgnents about what they read. Separating face from opinion or recog- 
nizing when important information is missing are some of the skills tested 
in critical comprehension. 



There is a total of 40 items on the CAT reading comprehension sub- test. On 
the average, Washington's 11th graders answered 722 of the items correctly 
compared with 642 correct in the national norm group. 

Spelling 

The items on the CAT spelling sub-test are organized around sounds- symbols 
(phoneme 8- graphemes) and the structural units of words (morphemes). The 
items emphasize the frequent errors that occur within each category. 
Spelling problems are tested in the consonant group and the vowel group, as 
well as, the structural or morphemic units of words. The test items 
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consist of underlined words presented in sentences. Students choose the 
incorrect wrd fro« three underlined words or if there sre no misspellings 
they select the answer choice '*none.** Washington's students answered an 
average of 60Z of nhe 20 items on the spelling test correctly compared with 
56Z correct in the norm group* 

Language Mechanics 

The language mechanics sulr-test consists of 25 items testing capitalization 
and punctuation skills. The ten capitalization items ask students to 
decide which of four underlined words in a sentence requires a capital 
letter. Each sentence also contains an alternate choice of "none** if no 
word requires a capital letter. The 15 punctuation items require students 
to determine which one of four punctuation marks included in a sentence is 
required. Again the choice "none** is provided if no additional punctuation 
is needed* 

Washington students answered 70% of the language mechanics items correctly 
compared with 642 correct in the norm group. 

Language Expression 

The language expression sub-test of the CAT focuses on the ability to apply 
language skills in written work. Students do no write in the test, but 
students must recognize the appropriate use of such writing concepts as 
subject-verb agreement, modifying and transitional words or phrases, and 
complete, incomplete or run-on sentences. Students* knowledge of parts of 
speech such as pronouns, nouns, adjectives and adverbs used in the context 
of sentences is also tested. 
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A thirJ Itntuage expression «re« requires students to arrange related 
sentences in a logical or appropriate sequence based on the meaning of the 
group of sentences. 

Of the 38 ite«s on the language expression sub-test, Washington students 
answered 71% correct compared to 66Z correct in the nom group. 

Mathematics Coaputation 

The CAT contains a sampling of computation skills commonly taught in the 
public schools. Items include problems requiring the addition, subtrac- 
tion, ti'iltiplication, and division of whole nuibers, fractions, mixed 
nwbers, decimals, and algebraic expressions. Common errors in computation 
are incorporated into the alternative answer choices, thus adding a diag- 
nostic dimension to the computation sub-test. 

There are 40 items on the mathematics computation sub- test. Washington's 
11th graders averaged 70% of the items correct compared with the norm 
group's 62Z average correct. 

Mathematics Concepts and Applications 

The concepts and applications sub-test of the CAT tests broad range of 
mathematics ukills with emphasis on concepts and their application rather 
than on isolated facts. The objectives measured in tMs sub-test include 
nmeration, nimiber theory, ntuber sentences, and number properties. 
Generally, these items test the student's knowledge of the symbols and 
words that represent nmbers, the organization of these symbols, and the 
rules that govern these symbols. Other items in the CAT mathematics 
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concepts and applications sub-* test focus on geometry | measurement , graphs 
and functions. All items have four possible answer choices with a fifth 
choice 9 "none of the above" to discourage uninformed guessing. The 
Washington 11th graders answered correctly an average of 67Z of the 45 
concepts and applications items compared with 60Z correct for the norm 
group. 

Appendix B of this report contains the complete Item Summary Report for the 
1981 11th grade CAT administration. 

LIMITATIONS OF THE REPORT 

The results reported have several important limitations: 

1. The California Achievement Test measures a limited niinber of 
skills in readingi spellingi language, and mathematics. There dre 
other important skills in these areas not tested by the CAT. 
There are also many other important subject areas not tested such 
as science, music, history, foreign languages, or art as well as 
citizenship, study habits, or attitudes toward school. 

2. Many factors influence students* success in school. These test 
results can offer some information about the degree of success, 
but they provide little information about causes. 
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Bectute of the nature of the sampling process, the results 
reported in this document are applicable only to the total group 
of public school 11th graders in Washington in May, 1981. No 
generalizations can or should be made to specific schools or 
school districts. Districts who routinely use the CAT with their 
11th grade students could, of course, compare their students* 
performance with the state performance described in this report. 

Finally, test results, thoughtfully used, can provide valuable 
information about students' strengths and weaknesses and the 
effectiveness of instructional programs. However, test results 
should always be used in context with other factors such as local 
program priorities, school climate and allocation of instructional 
time and resources. 
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Appendix A 



Below are the mean raw scores and scale scores together with their standard 
errors for each sub-test, sub-test total and total battery, on the May, 
1981, Washington State 11th grade test. 

Also provided are the mean national percentile scores which were derived by 
converting the mean scale scores to their corresponding percentile ranks 
taken from the publisher's empirical norms table. 



WafthingCon Stdtruido AssctimcnC Progran 
r.ilifornJT Achicvenent Test 
Grade 11 - Uvtl 190 
Spring 1981 

rF.AO READ READ UNC UHC UNC MATH ^♦ATn :*ATn TOTAL 

VOCAP. CO:!P TOTAL RPELL MEC!l EXPR TOTAL COMP CO/AP TOTAL ^AT 



•^an Raw Scorr 21 29 50 12 17 27 44 28 30 5« 165 

*:t;in(!.irc' Frror 0.2AA 0.258 O.A79 0.125 0.163 0.226 0.379 0.319 0.330 0.620 1.469 

v^^.M ';c.nlc Scorn «i52 650 652 637 632 637 638 642 642 643 646 

<rnna.iM Krror 3.234 2.821 2.932 2.797 2.848 3.161 3*155 3.039 2.980 3.035 3.137 

Percent llr U.ink 62 63 64 58 58 59 58 62 60 62 62 
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Appendix B 



Washington Scacewide Assessment: PrograiD 
California Achievement Test 
11th Grade - Level 19C 
Spring, 1981 

STATE ITEM SUMMARY REPORT 

The following pages contain the complete Item Summary Report for the 1981 
Uth grade assessment. The percentage of students answering each item 
correctly is presented by sub-test. The items are grouped by concept or 
skill area and by the CAT objective they measure. A complete description 
of the objectives, concepts, and skills measured by the CAT is provided in 
the scope and sequence section of the Test Coordinator's Manual. 

Three colians of percentages are reported. The first column reports the 
percentage of student* in Washington answering each item correctly. The 
second coltsin reports the percentages for the National reference (norm) 
group. The third colmn reports the difference in percentage points be- 
tween Washington and the norm group. When the difference favors 
Washington, no symbol precedes the percent in colimn three. When the 
difference favors the norm group, a minus sign precedes the percentage. 

IO04B7.0O 
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State Right Response Summary 



The State Right Response Summary provides an analysis of the performance 
of the sample of Washington eleventh- graders on individual and groups of 
items in the California Achievement Test. The analysis is first divided 
by subtests (Test 1 ~ Reading Vocabulary, Test 2 — Reading Comprehension, 
etc.). The second division is by content domain (literal comprehension, 
interpretive comprehension, etc.). The third dimension is based on category 
objectives such as recall of facts, inferred meaning, etc. 

For each of the items, the following information is provided about the 
students* performance: 

1. The percentages (PCT) of students omitting, giving wrong, or 
giving right responses; 

2. The percentage of students in the national norm group (national 
reference group) answering the item correctly. These figures — 
displayed in the three right-hand columns — are item difficulty 
values for each applicable grade at the time the CAT was "normed." 
The center column (11.7) corresponds to the time of year Washington 
students were tested and is therefore the percentage to be compared 
with Washington's "right percentage;" and 

3. The difference between Washington's and the norm group's percents 
correct for each item and objective (far right-hand column). 
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State Right Response Summary 
California Achievement Test 
May, 1981 - Form C, Level 19 
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